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Amendments to the Claims : 

This listing of claims will replace all prior versions, and 
listings, of claims in the application: 

Listing of Claims : 

1. (Currently Amended) A learning item sequencing system 
for optimizing a student's learning speed, the system 
comprising: 

a computer including one or more memory portions; 

the memory portions comprising: 

a problem database containing a plurality of learning 
items, wherein a learning item is presented on each learning 
trial; 

a trial record database, for storing response data 
regarding the student's response to each learning ite m, wherein 
the response data includes data relating to speed and accuracy ; 

software for implementing a trial loop, wherein the 
learning trials are presented to the student and response data 
are collected; and 

software for implementing a sequencing algorithm, 
wherein the algorithm sequences the learning items to be 
presented by associating with a learning item a priority score 
as a function of the response data collected from prior learning 
trials and restricts one or more learning items from being 
presented in at least one learning trial based upon the priority 
score associated with the learning item. 
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2. (Original) The sequencing system of claim 1, wherein 
the response data collected for each learning trial includes the 
student's accuracy in answering the presented learning item and 
the student's response speed if the item was correctly answered. 

3. (Original) The sequencing system of claim 2, wherein 
each learning trial includes a priority score associated with 
the particular learning item. 

4. (Original) The sequencing system of claim 3, wherein 
the sequencing algorithm continuously updates the priority score 
of each learning item based on the response data collected on 
the immediately preceding learning trial. 

5. (Original) The sequencing system of claim 4, wherein 
the number of trials since a particular learning item was last 
presented is a variable used by the sequencing algorithm in 
continuously updating the priority score of each learning item. 

6. (Currently Amended) The sequencing system of claim 4, 
wherein [the] relative importance of the student's speed and 
accuracy in sequencing of learning items is a parameter. 

7. (Original) The sequencing system of claim 5, wherein 
the software for implementing a trial loop includes a problem 
selector, the problem selector selecting the learning item with 
the highest priority score for presentation to the student. 
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8. (Original) The sequencing system of claim 6, wherein 
when a subset of the plurality of learning items have the same 
high priority score, the problem selector selects the learning 
item for presentation at random from the subset of learning 
items with the same high priority score. 

9. (Currently Amended) The sequencing system of claim 6, 
wherein the sequencing algorithm increases the priority score 
for each incorrectly answered learning item, wherein the 
probability of each incorrectly answered learning item being 
again selected by the problem selector increases, whereby [fcke] 
delay in learning item reappearance decreases. 

10. (Currently Amended) The sequencing system of claim 6, 
wherein the sequencing algorithm decreases the priority score 
for each correctly answered learning item, wherein the 
probability of that learning item being again selected by the 
problem selector decreases, whereby [the] delay in learning item 
reoccurrence increases . 

11. (Currently Amended) The sequencing system of claim 10, 
wherein the sequencing algorithm decreases the priority score 
for each correctly answered learning item as a function of the 
student's response time in answering the question, wherein [the] 
delay in a particular learning item' s reappearance increases as 
the student's response time to the particular learning item 
decreases . 
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12. (Original) The sequencing system of claim 5, wherein 
the sequencing algorithm prevents the same learning item from 
recurring for a predetermined number of trials. 

13. (Original) The sequencing system of claim 6, wherein 
each learning item may be assigned an initial priority score. 

14. (Original) The sequencing system of claim 13, wherein 
the sequencing algorithm does not modify the priority score of 
each item until after its first presentation. 

15. (Original) The sequencing system of claim 14, wherein 
the initial order of appearance of all, or some, of the learning 
items may determined in advance by assigning all, or some, of 
the learning items initial priority scores in ascending or 
descending order. 

16. (Original) The sequencing system of claim 11, wherein 
the software for implementing the trial loop includes a learning 
item retirement feature, wherein the learning items are retired 
from the problem database upon meeting a predetermined learning 
criterion. 

17. (Currently Amended) The sequencing system of claim 16, 
wherein [^fe^e] a learning criterion for each particular learning 
item is a function of the student's accuracy in answering the 
learning item, and response speed for each correct answer, over 
a predetermined number of repetitions of the learning item. 
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18. (Original) The sequencing system of claim 17, wherein 
a session resumption feature stores an individual learner's data 
for learning items, in terms of speed, accuracy, and problem 
retirement status for continuing the learning during another 
session at a later time. 

19. (Original) The sequencing system of claim 17, wherein 
the session resumption, feature allows, learning to continue at 
another time whence the retirement count of retired learning 
items is reduced, bringing them back for review and "re- 
retiring" if performance still meets learning criteria. 

20. (Original) The sequencing system of claim 17, wherein 
the session resumption feature allows previously retired 
learning items brought back for review to rejoin the active 
problem set if performance criteria do not meet the previously 
established learning criteria. 

21. (Original) A learning item sequencing system for 
optimizing a student's learning, comprising: 

a computer including a central processing unit, a visual 
display device, at least one input device, and one or more 
memory portions; 

the memory portions comprising: 

a problem database, wherein a plurality of learning 
items for presentation to the student is stored in the database, 
and further wherein each learning item has an associated 
priority score; 
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a trial record database, for storing a record 
containing response data regarding the student's response to 
each learning item, the response data collected for each 
learning item including the student's accuracy in answering each 
learning item and the student's response speed for each 
correctly answered learning item, the response data further 
f including the number of trials since each partiSirtar Irerarrrring- 
item was last presented; ' 

software for implementing a trial loop, wherein the 

f learning trials are presented to the student and the response 
data are collected, the software including a problem selector, \ 
wherein the problem selector selects the learning item with the 
highest priority score for presentation to the student; and | 

software for implementing a sequencing algorithm, 
wherein the algorithm continuously updates the priority scores 
for each learning item as a function of the response data 
collected from the prior learning trials, the sequencing 
algorithm increasing the priority score for each incorrectly 
answered learning item and decreasing the priority score for 
each correctly answered learning item, wherein the probability 
of a particular learning item being again selected by the 
problem selector increases or decreases as a function of 
priority score, 

22. (Original) The sequencing system of claim 21, wherein 
the sequencing algorithm continuously updates the priority score 
of each learning item based on the response data collected for 
the immediately proceeding learning trial. 
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23. (Original) The sequencing system of claim 21, wherein 
when a subset of the plurality of learning items have the same 
high priority score, the problem selector selects the learning 
item for presentation at random from the subset of learning 
items with the same high priority score. 

24. (Original) The sequencing system of claim 21, wherein 
the sequencing algorithm decreases the priority score for each 
correctly answered learning item as a function of the student's 
response time in answering the question, wherein the faster the 
student's response time the greater the decrease in priority 
score . 

25. (Original) The sequencing system of claim 21, wherein 
the sequencing algorithm prevents the same learning item from 
recurring for a predetermined number of trials. 

26. (Original) The sequencing system of claim 21, wherein 
the priority score associated with each learning item may be 
assigned an initial value. 

27. (Currently Amended) The sequencing system of claim 26, 
wherein the sequencing algorithm does not modify the priority 
score of each learning item until after the first presentation 
of each particular learning item. 

28. (Original) The sequencing system of claim 26, wherein 
the initial order of appearance of all, or some, of the learning 
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items may determined in advance by assigning all, or some, of 
the learning items initial priority scores in ascending or 
descending order. 

29. (Original) The sequencing system of claim 21, wherein 
the software for implementing the trial loop includes a learning 
item retirement feature, wherein the learning items are retired 
from the problem database upon meeting a predetermined learning 
criterion . 

30. (Original) The sequencing system of claim 21, wherein 
the learning criterion for each particular learning item is a 
function of the student's accuracy in answering that learning 
item, and response speed for each correct answer, over a 
predetermined number of repetitions of the learning item. 

31. (Currently Amended) A method for learning item 
sequencing for optimizing a student's learning speed, the method 
comprising : 

supplying a computer including one or more memory portions; 
the memory portions having software which performs the 
steps of: 

building and maintaining a problem database containing 
a plurality of learning items; 

building and maintaining a trial record database, for 
storing response data regarding the student's response to each 
learning item , wherein the response data includes data relating 
to speed and accuracy ; 
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implementing a trial loop, wherein the learning items 
are presented to the student and response data are collected; 
and 

implementing a sequencing algorithm, wherein the 
algorithm sequences the learning items to be presented as a 
function of the response data collected from prior learning 
trials by associating priority scores with learning items and 
restricting certain learning items from being presented in at 
least one learning trial . 

32. (Withdrawn) A perceptual learning system for teaching 
students to recognize diagnostic structure from varying 
instances, the system comprising: 

a problem database containing a plurality of learning items 
which are examples of different concepts, which, with respect to 
any one concept, includes a number of positive instances 
containing diagnostic structural elements and a number of 
negative instances which do not contain the diagnostic 
structural elements of the concept; and 

software for implementing a trial loop, wherein the 
learning items are presented to the student in the form of short 
speeded classification trials. 

33. (Withdrawn) The perceptual learning system of claim 
32, wherein the problem database includes learning trials in the 
form of structure discovery trials and structure mapping trials, 
the structure discovery trials requiring the student to 
recognize the diagnostic structure that determines a concept in 
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a particular learning domain, distinguish positive and negative 
instances of the concept, and process the distinguishing 
information rapidly, and the structure mapping trials requiring 
the student to associate a structure in one representational 
format with the structure as it appears in one or more different 
representational formats . 

34. (Withdrawn) The perceptual learning system of claim 
33, wherein the problem database contains numerous instances 
exemplifying a given concept to be learned, and the set of 
instances systematically varies in attributes and dimensions 
other than the diagnostic structure determining the concept. 

35. (Withdrawn) The perceptual learning system of claim 
33, wherein for each concept to be learned, the problem database 
contains numerous instances not belonging to that concept, for 
use as negative instances in classification trials. 

36. (Withdrawn) The perceptual learning system of claim 
33, wherein for each concept to be learned, the negative 
instances systematically vary in their attributes and dimensions 
and share with positive instances of the concept various 
attributes and dimensions other than the diagnostic structure 
features determining inclusion of the concept. 

37. (Withdrawn) The perceptual learning system of claim 
32, wherein the learning trials include a pattern 
classification response or a pattern comparison response. 
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38. (Withdrawn) The perceptual learning system of claim 
32, wherein the student is given feedback regarding his 
performance after each learning trial. 

39. (Withdrawn) The perceptual learning system of claim 
32, further including a trial record database, for storing 
response data regarding the student's response to each learning 
item and the concept of which it is an instance, the response 
data including the accuracy of the student's answer to each 
learning item, and the speed of the student's response to each 
correctly answered learning item. 

40. (Withdrawn) The perceptual learning system of claim 
39, wherein the software for implementing the trial loop 
includes a retirement feature for concepts, wherein the 
individual concepts are retired from the problem database upon 
meeting a predetermined learning criterion for instances of that 
concept, wherein the learning criterion is a function of the 
student's accuracy in answering novel instances of that concept, 
and response speed for each correct answer, over a predetermined 
number of presentations of instances of that concept. 

41. (Withdrawn) The perceptual learning system of claim 
32, wherein the software for implementing a trial loop includes 
a problem selector, the problem selector selecting each learning 
item at random from the problem database. 
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42. (Withdrawn) The perceptual learning system of claim 
41, wherein the problem selector, selects each learning item 
from the problem database according to the system of claim 21. 

43. (Withdrawn) A perceptual learning system for teaching 
students to recognize diagnostic structure from varying 
instances, the system comprising: 

a computer including a central processing unit, a visual 
display device, at least one input device, and one or more 
memory portions; 

the memory portions comprising: 

a problem database containing a plurality of learning 
items, wherein each learning item is in the form of a structure 
discovery trial or a structure mapping trial, the structure 
discovery trials requiring the student to recognize the 
diagnostic structure that determines a concept in a particular 
learning domain, distinguish positive and negative instances of 
the concept, and process the distinguishing information rapidly, 
and the structure mapping trials requiring the student to 
associate a structure in one representational format with the 
structure as it appears in one or more different 
representational formats ; 

software for implementing a trial loop, wherein the 
learning trials are presented to the student in the form of 
short speeded classification trials, wherein the classification 
trials include a pattern classification response or a pattern 
comparison response . 
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44. (Withdrawn) The perceptual learning system of claim 
43, wherein the student is given feedback regarding his 
performance after each learning trial. 

45. (Withdrawn) The perceptual learning system of claim 
43, further including a trial record database, for storing 
response data regarding the student's response to each learning 
trial, the response data including the accuracy of the student's 
answer to each learning trial, and the speed of the student's 
response to each correctly answered learning trial. 

46. (Withdrawn) The perceptual learning system of claim 
43, wherein the software for implementing the trial loop 
includes a concept retirement feature, wherein concepts are 
retired from the problem database upon meeting a predetermined 
learning criterion, wherein the learning criterion is. a function 
of the student's accuracy in answering the instances of that 
concept, and response speed for each correct answer, over a 
predetermined number of repetitions of each concept. 

47. (Withdrawn) The sequencing system of claim 46, wherein 
the contributions to concept retirement of learner speed, 
accuracy, and number of presentations meeting speed and accuracy 
criteria, are parameter adjustable. 

48. (Withdrawn) The perceptual learning system of claim 
43, wherein the software for implementing a trial loop includes 
a problem selector, the problem selector selecting a learning 
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item for each learning trial at random from the problem 
database . 

49. (Withdrawn) The perceptual learning system of claim 
43, wherein the problem selector, selects a learning item for 
each learning trial from the problem database according to the 
system of claim 17. 

50. (Withdrawn) A perceptual learning method for teaching 
students to recognize diagnostic structure from varying 
instances, comprising the steps of: 

supplying a computer including one or more memory portions; 
the memory portions having software which performs the steps of: 
building and maintaining a problem database containing a 
plurality of learning items which are examples of different 
concepts, which, with respect to any one concept, includes a 
number of positive instances containing diagnostic structural 
elements and a number of negative instances which do not contain 
the diagnostic structural elements of the concept; and 
implementing a trial loop, wherein the learning trials are 
presented to the student in the form of short speeded 
classification trials. 

51. (Withdrawn) An automated, time-based hinting method 
for promoting learning and preventing student frustration, the 
method comprising the steps of: 

running a learning program; 

building and maintaining a database of hints 
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presenting a student with a learning trial; 

selecting a hint if the student fails to respond in a 
predetermined period of time or fails to answer the learning 
item for that trial correctly; and 

presenting the hint to the student. 

52. (Withdrawn) The hinting method of claim 51, further 
including the step of providing feedback to the student after 
the student has responded to the hint. 

53. (Withdrawn) The hinting method of claim 51, wherein 
the software selects hints from the group consisting of inverse 
operation hints, known problem hints, easy problem hints, and 
solved problem hints. 

54. (Withdrawn) The hinting method of claim 51, wherein 
the software includes a hint selector that selects hints at 
random from the database of hints. 

55. (Withdrawn) The hinting method of claim 51, wherein 
the software includes a hint selector that selects hints 
according to an algorithm. 

56. (Withdrawn) The hinting method of claim 53, wherein 
the software includes a hint selector that keeps track of 
previously used hints and hint categories to ensure that 
different hint types and instances are used about equally often. 



-16- 




Appln No. 10/020,718 

Amdt date October 9, 2003 

Reply to Office action of June 9, 2003 

57. (Withdrawn) An automated, time-based system for 
providing hints in order promote learning and prevent student 
frustration, the system comprising: 

a computer including a central processing unit, a visual 
display device, at least one input device, and one or more 
memory portions; 

the memory portions comprising: 

software for running a learning program; 
a hint database containing a plurality of hints; and 
software for implementing a hinting procedure, wherein a student 
is presented with a learning trial and a hint is selected and 
presented to the student if the student fails to respond in a 
predetermined period of time or fails to answer the learning 
item for that trial correctly. 

58. (Withdrawn) The hinting system of claim 57, wherein 
the hint procedure provides feedback to the student after the 
student has responded to the hint. 

59. (Withdrawn) The hinting system of claim 57, wherein 
hints are selected from the group consisting of inverse 
operation hints, known problem hints, easy problem hints, and 
solved problem hints. 

60. (Withdrawn) The hinting system of claim 57, wherein 
the software includes a hint selector that selects hints at 
random from the database of hints. 
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61. (Withdrawn) The hinting system of claim 57, wherein 
the hint procedure includes a hint selector that selects hints 
at random from the database of hints. 

62. (Withdrawn) The hinting system of claim 57, wherein 
the hint procedure includes a hint selector that keeps track of 
previously used hints to ensure that different hint types are 
used about equally often. 

63. (New) The learning system of claim 1, wherein the 
sequencing algorithm sequences categories of learning items. 

64. (New) The learning system of claim 1, wherein the 
learning items comprise categories of learning items. 

65. (New) The learning system of claim 1, wherein the 
sequencing algorithm further includes one or more parameters 
selected from the group consisting of relative importance of 
speed and accuracy, minimum trials separating learning item 
recurrence, and retirement criteria, wherein one or more 
parameters may be adjusted to suit different learning material, 
tasks or individuals. 

66. (New) The learning system of claim 21, wherein the 
sequencing algorithm sequences categories of learning items. 

67. (New) The learning system of claim 21, wherein the 
learning items comprise categories of learning items. 
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68. (New) The learning system of claim 21, wherein the 
sequencing algorithm further includes one or more parameters 
selected from the group consisting of relative importance of 
speed and accuracy, minimum trials separating learning item 
recurrence, and retirement criteria, wherein one or more 
parameters may be adjusted to suit different learning material, 
tasks or individuals. 



sequencing algorithm sequences categories of learning items. 



learning items comprise categories of items. 

71. (New) The learning item sequencing method of claim 31, 
wherein the step of building and maintaining a problem database 
containing a plurality of learning items comprises building a 
plurality of learning items representing categories of items. 

72. (New) The learning sequencing method of claim 31, 
wherein the sequencing algorithm further includes one or more 
parameters selected from the group consisting of relative 
importance of speed and accuracy, minimum trials separating 
learning item recurrence, and retirement criteria, wherein one 
or more parameters are adjusted to suit different learning 
material, tasks or individuals. 




(New) 



The learning system of claim 21, wherein the 




(New) The learning system of claim 21, wherein the 



